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Abstract 

We relate the "Fourier" orbital integrals of corresponding spherical functions on 
the p-adic groups SO{h) and PGL{2). The correspondence is defined by a "lifting" 
of representations of these groups. This is a local "fundamental lemma" needed to 
compare the geometric sides of the global Fourier summation formulae (or relative 
trace formulae) on these two groups. This comparison leads to conclusions about 
a well known lifting of representations from PGL{2) to PGSp{4). This lifting 
produces counter examples to the Ramanujan conjecture. 



Introduction. Let G be the special orthogonal group, defined over a local field F, 
by an anti-diagonal form, with upper triangular minimal parabolic subgroup. An explicit 
definition is given in Section 0, where G is denoted by SO{3,2). Let Gg {6 G F^) be 
a subgroup of G isomorphic to the special orthogonal groups 5*0(2,2) or 50(3,1) (see 
Section 0). Denote by P the maximal upper triangular parabolic subgroup of G with 
abelian unipotent radical A^. For any spherical function / e Gc{K\G/ K), K being the 
standard maximal compact subgroup of G, consider the Fourier orbital integral 




f{ngh)TpN{n)dhdn, 

IN JCe 

where ip^ isa. certain character on N depending on a fixed character ijj oi F with conductor 
R (integers of F). The A^-Og-orbits of maximal dimension are of the form Naa'joGg, where 
tta is the diagonal matrix diag(a, 1, 1, 1, a~^) and 70 is defined below. We are interested 
in g of the form 00,70, and denote the integral for such g by ^'(a, /). 

Let H be the group PGL{2) over F. By the Bruhat decomposition it is N'A' U 
N'wN'A'. Define a character on the upper unipotent subgroup A^' by ip^'ln') = ip{x), 
where n' = n'{x) G A^'. 
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For any spherical function /' on H (i.e. / e Cc{K'\H/K')), define the Fourier orbital 
integral 

/ f'{n'wn'{a)a')jj;N'{n')L{a')da'dn', 

Jn' J A' 

where i is xo (the unramified quadratic character on F^) in the split case, and 1 in the 
non-split case. 

Let TT^ = -^g(C) 1/2 + C) be a (certain) unramified representation of G, induced from 
its Borel subgroup B. Let vr^ = Ih{C, —() be a (certain) unramified representation of H, 
induced from its Borel subgroup B'. Wc say that two spherical functions f on G and /' 
on H are corresponding if their Satake transforms are equal, i.e. tr 7r^(/) = tr 7i'^{f'), for 
all complex numbers 

Consider a pair of corresponding functions (/, /') . The main result of this paper shows 
that their Fourier orbital integrals are related by 

where {9, a) is a Hilbert symbol. 

Our paper was motivated by Flicker-Mars [FM], which deals with lifting representa- 
tions from H = PGL(2) to G = PGSp{A). It uses the property that the hfts have periods 
with respect to the cycle (closed subgroup) C^. Here Ce is the centralizer of diag(ae,a6i) 
(ag = antidiag(l, ^^)) in G. This property led [FM] to apply the theory of the Fourier 
summation formula for PGSp{4:) and the cycle Cg over a global field. This summation 
formula is a special case of Jacquet's relative trace formula. Other approaches to estab- 
lishing this hfting of representations use the theory of the Weil representation (see Oda 
[O], Rallis-Schiffmann [R], [RS], Langlands [L], Piatctski- Shapiro [PS]). 

The Fourier summation formula is obtained by integrating the kernel Kf{n,h), in 
fact its product Kf{n, h)ip^{n) with the complex conjugate of the value of the character 
ipN on N(A), over n e N(F)\N(A) and h e Ce(F)\Ce(A). This kernel of the convo- 
lution operator r(/) on the space of cusp forms on G(A), has the geometric expansion 
X]7gG(f) ^ spectral expansion. One compares the geometric side of the 
summation formula on G(A) (= PGSp{4, A)) to the geometric side of a similar summa- 
tion formula on H(A) (= PGL{2, A)). The equality of the geometric sides (for different 
test functions) imphes the equality of the spectral sides of these two formulae. This can 
be used to obtain various conclusions about hfting of representations from PGL(2, A) to 
PGSp{4:, A). To carry out the separation argument which plays a key role in these studies 
one needs a "fundamental lemma" , which asserts that corresponding spherical functions 
on PGSp{A) and PGL{2) have matching Fourier orbital integrals. 

Proposition 8 of [FM] states a precise form of the conjectured fundamental lemma. 
A direct proof of this statement for the unit elements in the Hecke algebras is given in 
Proposition 6 of [FM]. 

Note that under the isomorphism of PGSp{4) with 5*0(3,2), if is a square in , 
the image of Cg is the split group 5*0(2,2), and if 6 is non-square, it is 5*0(3, 1). This 
paper proves the fundamental lemma conjectured in [FM] for the pairs of local groups 
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SO{3, 2)/SO{3, 1) and SO{3, 2)/SO{2, 2); remarkable cancellations simplify the proof, in- 
deed make it possible. 

The proof is based on computing the Fourier transforms of the orbital integrals (re- 
ferred to also as the Mellin transform, since the variable of integration is multiplicative). 
By the Fourier inversion formula, the equahty of the Fourier transforms of the orbital 
integrals implies the equality of the orbital integrals themselves. This approach avoids 
dealing with the asymptotic behaviour of our orbital integrals. It was first used in Jacquet 
[J] for the unit element, and then extended by Mao [M] for the general elements (in their 
case of GL{3)). In our case, the unit element is treated in [FM] by direct computa- 
tions. Here, we give the complete proof of the "fundamental lemma" of [FM]. Another 
interesting question in this direction is the generalization of these results to the case of 
SO{n) / SO{n — 1). We hope that this method would apply in this case too. 

Our "Fourier" situation is significantly different from that of standard conjugacy, 
where it is known that: (1) the fundamental lemma for the unit element implies it for 
general spherical functions, and (2) the knowledge of the transfer of orbital integrals of 
general functions implies in principle the fundamental lemma for the unit element, and 
vice versa. No such results are known in the "Fourier" setting of this paper, in particular 
since there is no analogue of the reduction of orbital integrals to ones of elliptic elements 
on Levi factors. Of course it will be of much interest to establish analogous of (1) and (2) 
in the "Fourier" case. 

Professor Y. Flicker suggested this problem to me. I would like to thank him for 
numerous helpful discussions on this subject, and Dr. Z. Mao for discussions about his 
paper. 

0. Statement of results. Let F be a local non-archimedean field, of residual character- 
istic 7^ 2. Denote by R the (local) ring of integers of F. Let tt e F be a generator of the 
maximal ideal of R. Denote by q the number of elements of the residue field F = R/ttR 
of R. Normalize the absolute value on by |7r| = q^^. Fix an additive character ijj on 
F with conductor R (i.e. ip is trivial on R but not on tt~^R). 

Let G — SO{3,2;F) be the the group of G SL{5;F) with ''gJg = J, where is 
the transpose of g and J = J5. Here J„ = {5n+i-i,i) is the n by n matrix with I's on 
the antidiagonal and O's everywhere else. Then G is the split special orthogonal group 
in five variables. Denote by V the five dimensional vector space of columns, over F. 
The group G acts on V via multiplication on the left. In the split case, let Vq G V he 
the column *(0, 0, 1, 0, 0). Set C = StabG(t'o)- Then C is the split special orthogonal 
group over F in 4 variables; we denote it by SO{2,2; F). The symmetric space G/C is 
known to be isomorphic (via the map g 1— gvo) to a four dimensional closed subvariety 
S of V, given by a quadratic equation. In the non-split case, let vq E V he the column 
*(0,2^,0, 1,0), d not in (F^)^. In Section 1.2 we define a subgroup C'q of PGSp{A). We 
denote by Ce = S0{3, 1;F) the image of Cq under the isomorphism from PGSp^A) to 
SO {3,2). In Lemma 1.4 we show that Cq — ^tahGivo). The quotient G/Cq is known 
to be isomorphic (via the map g 1— > gvo) to a four dimensional closed subvariety S of V , 
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given by a quadratic equation. To simplify the notations, we write Cq for both spht and 
non-spht cases. The spht case corresponds to Cx, where Ci = C. 

Denote by P the maximal upper triangular parabolic subgroup of G with abelian 
unipotent radical, N . The subgroup B denotes the upper triangular Borel subgroup of 
G. Let K = S0{3, 2; R) be the standard maximal compact subgroup of G. Define 

A = {a^ = diag(a,l,l,l,Q;"^); a e F""}, M = {diag(l, m, 1); m e S0{J3)}. 

Then P — NMA. Let Aq be the diagonal subgroup of G and A^o the maximal unipotent 
subgroup of B. We have B = AqNq. Note that A'" is a subgroup of A^o, isomorphic to F^. 
We will write n = n{xi, X2, x-^) (as in I.l). In the split case, define a character i/jj^ on by 
V'Af(^) = ^^(2^2)) where n = n{xi,X2, x-^). In the non-split case, set ipNfi{n) = ip{xi + 29x3). 

The subgroup A^ acts on G/Ce by multiplication on the left, turning it into a disjoint 
union of A^-orbits. By Proposition 1.5 of Section I the A^-C^-double cosets in G of maximal 
dimension (which is equal to 9, as dim(A^) = 3 and dim(Ce) = 6) are represented by 00,70, 
Oq, e A, for a certain matrix 70, defined at the beginning of Section I. Moreover the A^- 
orbits of S of maximal dimension, 3, are of the form Na^'yo'i^Oi (^a ^ A. 

As usual, denote by C{X) the space of complex valued functions on an /-space X 
(see [BZ]), and in C^{X), the subscript "c" indicates "compactly supported", and "00" 
means "locally constant". For any / e G^{G), define 

(l^figvo) = / f{gh)dh. 
Jc 

Then (pf G C^{S). If / is a spherical function (i.e. fT-biinvariant, or / G Cc{K\G/ K)), 
or even if only / G Ce{K\G), then 0/ G Cc{K\S). For any G C^{S), define the orbital 
integral 

*(q;,0)= / (t){naa'^oVo)il)N{n)dn. 
Jn 

Let H be the group PGL(2, F). Its elements will be denoted by their representatives 
in GL{2). Note that H has a trivial center. Denote by B' the upper triangular Borel 
subgroup of H. Let K' — PGL{2, R) be the standard maximal compact subgroup of H. 
We have B' = N'A', where 

AT' = |n(a;) = J 1 ) ^ ^ ^ ^} ' ^' = { ( S)'"^^'}' 

Define a character ipN' of A^' by ipN'{n{x)) = ip{x). Let xo be the trivial or an unramified 
quadratic character of F^ (i.e. Xo(7r)^ = 1, and Xo{R^) = 1)- Put t = Xo in the split case 
and 1 in the non-split case. Define the integral 

""^"'^'^'LIj'H-i o)(o i)(o 
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Denote by Cc{N'\H,ipN') the space of complex valued compactly supported modulo 
A^' functions (J)' on H, which satisfy (for any n e A^') the relation 

(l)'(ng) = 'ijjN,{n)(l)'{g), 

where z denotes the complex conjugate of z. Write Cc{N'\H/ K', iI)n') for the space of such 
right i^'-invariant functions. Given /' G C^{H), define a function 0^, G Cc{N'\H,ipj^') 
on H by 

<P'f'{9) = / '4^N'in)f'{ng)dn. 

J N' 

If /' is X'-biinvariant, then 0^, G Cc{N'\H/ K','^^')- Define the integral 

Thus, by definition ^'(q;,0'^,) = ^!H{ot,f'). 

Definition. The functions / G C^{G) and /' G C^{H) are called matching if for 
every a & we have 

^(q;,0/) = {9,a)ip{a)\a\'^'{a~'^,4>'j:,). 

Note that in the split case (9, a) — 1. 

Let TT = Ig{C, CO be the representation of the group G which is normalizedly induced 
from the character |ai|''|a2|'' of the Borel subgroup, B, where ai and a2 are the two 
simple roots of G with respect to B. The space of this representation consists of locally 
constant functions 0, such that 

(f){nak) = 6^J'^ {a)\ai{a)\''\a2{a)\'' (l){k), 

where n & N, a — dieig{a, (3, 1, l3~^,a~^) and ai{a) — a/ (3, 0:2(0) — G acts by right 
translation. Let / be a 7^-biinvariant, compactly supported function. Define its Satake 
transform by /^(tt) = tr7r(/). 

Let TT^ = Ih, xo(C)~C) be the representation of the group H which is normalizedly 
induced from the character 



/ a 


n \ 


a 


[ 




b 



of B'. 

Let /' be a fC'-biinvariant, compactly supported function on H. Its Satake transform 
is defined again by /'"^(tt') = tr7r'(/'). 



5 



Definition. The X-biinvariant function f on G and the X'-biinvariant function /' 
on H are called corresponding if for any complex number ^ we have 

r (vr,) = r «), 

where vr^; = /^(C, 1/2 + and tt^ = ^h,xo{Ct ~C) the representations of G and H 
defined above. 



The unit elements f and /'° of the Hecke algebras Cc{K\G/K) and Cc{K'\H/K'), 
which are the characteristic functions of K and K' divided by their volumes, are corre- 
sponding. It is shown in [FM] that they are matching. The main result of this paper is 
the following extension of that result, conjectured in [FM]. 



Theorem. Corresponding f and f are matching. 



Our approach is analogous to that of [J]. [M]. An alternative approach would be to 
directly compute the integral. The general structure of the proof is as follows. Under the 
action of K, S can be decomposed into i^-orbits. Each orbit has a representative (see 
Proposition 1.7) of the form drVi (r > 0), where dr — diag(7r'', 1, 1, 1, tt"''). In the split 
case vi — *(l/2, 0, 0, 0, 1), in the non-split case vi — *{29, 0, 0, 1, 1). The main result of 
Section I is Proposition 1.8, which computes the volume of KdrVi. This section contains 
also some results needed in Section II. 

We write = 0' (where G Cc{K\S) and 0' e Cc{N'\H / K'^i^n')) if 

I (t){s)T(^{s)ds = I (t)'{a)WQ{a)\a\-^da. 

Js J A' 

Here is the X-invariant function on S, such that T^(do'yi) = 1 and for r > 1 (see 
Proposition 2.2) 

where the "— " sign occurs in the split case and "+" in the non-split case. The function 
W(; is the normalized unramified Whittaker function in the space of the representation tt^ 
(see Proposition 2.4). 

We show in Proposition 2.5 that is a linear bijection between the spaces Cc{K\S) 
and Cc{N'\H/K\ijN')- 

The map f ^ (f)/ from Cc{K\G/K) to Cc{K\S), and the map /' ^ from 
Cc{K'\H/K') to Cc{N'\H/K',ijN'), are used in Section II to show that the relation 
/^(tt^) = /'^(vr^) is equivalent to J-'{4>f) = (p'f/- 

Define (pr to be the characteristic function of the orbit KdrVi. Since K\S is the dis- 
joint union of KdrVi, r > 1, (Proposition 1.3) the set {(t)r'-iT > 0} is a basis of the space 
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Cc{K\S). Define = J2l=o ^i- Then the set {$^; r > 0} is also a basis of Cc{K\S). 

Now, wc consider the group H. Since H = N'A'K', any function in Cc{N'\H/ K' , i/jn') 
is defined by its values on A'. For r > 0, define the function 0^ in this space by 



a \ \ _ j 1, if |q;| = 
''VVO otherwise 



—r 



We show in Proposition 2.4(2) that 0'(diag(Q;, 1)) = if |a| > 1. Hence, the set {0^; r > 0} 
is a basis of Cc{N'\H/K\'4>n>)- Without lost of generality we assume that Xo(7r) = — 1. 
Indeed, if this is not the case then we can change the basis 0^ ^ (—1)^0^. Set 0^ = 
if r < 0. The main result of Section II asserts that for any integer r > 0, we have 

^($,) = (-i)v(0;±0;-i),i-e. 



^r{s)T^{s)ds = {-lYq'- / {<p'^{a)±<p'^_^{a))W(^{a)\a\-^da, 

S J A' 

where as usual the "+" sign occurs in the split case, and the "— " in the non-split 
case. Thus, if two spherical functions / G C^{G) and /' G C^{H) are correspond- 
ing we have = Since J-' : Cc{K\S) — > Cc{N'\H/K',iIjn') is an isomorphism of 
two vector spaces, to prove that corresponding functions are matching (i.e. 'i/{a,4>f) — 
{9, a)ip{a)\a\'if' {a~^ , 0^/)) it is enough to show that (for r > 0) 

*(a, = (9, a)V'(a)|a|*'(a-\ (-1) V(</'; ± <l>r-i))- 



In Section III we show that (for any r > 1) 

/ ^{a,^r)x{o^)d'<a= [ (^,Q;)V(a)|a|*'(a"\(-l)V(0;±0;-i))x(«)rf^«, 

where x is any complex valued character of . The case r = follows from this result 
and from the case of the unit element, treated in [FM]. If x is ramified both integrals are 
equal to 0. The Fourier inversion formula now imphes the required result for the split 
case. 



I. The group G, subgroup C and the i^-orbits of G/C. 



1.1. The group G. The group G = S0{3, 2) can also be defined as 

{g G GL{5); Q{gv,gv) = Q{v,v), det{g) = 1}, 

where Q{v,w) = ^vJw, hence Q{v,v) = ^vJv = 2fif5 + 2V2V4 -|- f | is a quadratic form 
on the 5 dimensional vector space V of columns. Let P be the maximal upper triangular 
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parabolic subgroup of G with abelian unipotent radical, N. Let B be the upper triangular 
Borel subgroup of G. 



Definition. Define the matrix 



n = n{xi,X2,X3,Xi) 



( 1 


^3 


X2 


x[ 


z 


\ 





1 


—X4 


2-^4 


Xi 










1 


X4 


X2 













1 

















1 


/ 



where 



X3 + ^3 = 0, X2 + x'2 = Xi + x\ = 



+ ^2:3X4, z = -X1X3 - ^a;2. (2) 



Let Ao = {diag(Q;, /3, o;"^); q;,/5 7^ 0} be the diagonal subgroup of G. Let Nq = 

{n — X2, X3, X4)} be the upper triangular maximal unipotent subgroup of Bq. Put 
n{xi, X2, X2) — n{xi,X2, X3, 0). We have B = AqNo and P = NMA, where 




; m e SOiJ^) 














.,.=1 




I 


















and N = {n = n{xi, X2, X3)}. The standard Levi subgroup of P is the product MA. 

If 3:4 = the condition (2) reduces to x[ + Xi — {i — 1, 2, 3) and z — —xiXs — ^x^- 
We define G = G{F), P = P(F), = N(F), A = A{F), Nq = No(F) and Aq = Ao{F). 
Define the character ipi\f on A^. In the split case, let ip]\f{n{xi, X2, x^)) = ip{x2)- In the 
non-split case, let '4'N,e{'n{xi, X2, x^)) = ip{xi + 26x3). 

Consider the split case. Put 










A2 \ 






1 











A, J 



Ai A2 
A3 A4 



e 50 (J4) 



Lemma 1.1. Put Vq = *(0, 0, 1, 0, 0), and C = C{F). Then C is the stabilizer ofvo under 
the action of G on V , and the map g 1— > qvq embeds G/G into S, where S is the sphere v 
in V such that Q{v, v) — 1. 

Proof. Clearly C = StabG(fo)- Since G is the group SO (J), and the third column x of 
any element of G is gvQ, x satisfies the condition Q{x,x) = 1. □ 

RemEirk. Note that 

S = {\xi, X2, X3, xa, x^) e V] 2x1X5 + 2a;2a;4 + xl = 1}. 
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1.2. The isomorphism between SO{3,2) and PGSp{A). Let G' be the group 

PGSp{A, F) of matrices g E GL{A,F) such that gJ'^g = XJ', where J' is the ma- 
trix antidiag(l, 1, — 1, — 1) and A G . Fix 6 G F^ which is not a square. Let ag = 
antidiag(l, 6'). Let C'q be the centralizer of diag(a6i, a^) in G'. Let A^' be the unipotent 
radical of the Siegel parabohc subgroup P' of type (2, 2) of G'. RecaU that 

Fix a complex valued non-trivial character i(j oi F and define the character ipg of N' by 
V'el^) — i^i^ ~ dy). The stabilizer of this character is a non-split torus (see [FM]). 

Definition. Define a five dimensional space X by 

x^{Te Mi{F)] \TJ') = -rj',tr(r) = 0}. 

Choose the basis {ei, 62, 63, 64, 65} oi X so that 

T = T{xi, X2, X3, X4, X5) = xiti 2:262 ^363 2:464 X565 

is represented by the matrix 

/ —3:3/2 3:4 xi/2 
X2/2 x^/2 
0:5 X3/2 

\ -X5 X2/2 

The inner form on this space is (Ti,T2) = tr(TiT2), where Ti, T2 are in X. Define an 
action of G' on X via g: T ^ gTg~^. 

Lemma 1.2. The action g: T gTg~^ of G' = PGSp^i) on X is well defined and 
establishes an isomorphism from G' — PGSp{4) to G — 5*0(3, 2) = SO{J). 

Proof. To show that this action is well defined, we have to prove that ^{gTg^^J') ~ 
-gTg~^J' . This relation is equivalent to ^J'^g'^^T^g = -gTg~^J' . Multiplying both 

sides by g~^ on the left and by ^g~^ on the right, we obtain g~^^J'^g~^^T — —Tg'^J'^g'^. 
But g~^J'^g~^ — XJ' impfies that g~^^J'^g~^ — A* J'. We arrive at 

A*J'*r = -Tg-^J'^g-^ = -XT J', 

which is true since T G X. 

Further if Ti = Ti{xi, X2, X3, X4, X5) and T2 = T2{yi, 2/2, 2/3, 2/4, 2/5) then 

tr(rir2) = 2^12/5 + 2:22/4 + 2:32/3 + 2:42/2 + 2:52/1- 



\ 

-2:1/2 
X4 
-2:3/2 / 



(3) 
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Since tr(grTiT2g'~^) = tr(rir2), the action of G' on X defines an orthogonal group on X. 
The space X is isomorphic to the 5 dimensional vector space V, from Section I.l. Thus 
this orthogonal group is the group G — SO {J). □ 

Lemma 1.3. Under the isomorphism of Lemma 1.1, the image of subgroup C'g is Co, the 
centralizer (in G) of 



f 


-1 














\ 













29 















-1 




























\ 














-1 


/ 



Proof. By matrix multiplication 



/ 


1 





\ 


/ -2:3/2 


X4 xi/2 \ 




(0 


9-' 








\ 


e 











X2/2 


0:3/2 -xi/2 




1 






















1 




a;3/2 X4 













9-' 









e 






-X5 X2/2 -Xs/2 J 









1 





/ 










/ X3/2 


X2/{29) -xi/2 




\ 




















9X4 


-0:3/2 a:i/2 






















-X5 


-X3/2 X2/{29) 




















V 


X5 0X4 X2,/2 


J 













which implies the lemma. □ 



Note that under the isomorphism between G' and G, the unipotent subgroup N' of G' 
is isomorphic to the subgroup N oi G via 



/ 1 X y\ 

1 z X 

10 

V 1 J 



In particular z 
N. 



9y 



( 1 -y 

1 





\ 



-2x 2z 2zy - 2x^ \ 





1 
1 




-2z 

2x 

y 
1 



I 



■\{x\ + 2^X3) which justifies the choice of the character -^jv.e on 



Lemma 1.4. Put vq — *(0, 2^, 0, 1, 0). Then Cq is the stabilizer of vq under the action of 
G on V , and the map g 1— > gv^ embeds G/Cq into S, where S is the sphere v in V such 
that Q{v,v) = 46*. 
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Proof. The image of the subgroup in G is the subgroup Ce, which consists of matrices 
of the form 



V 



On 


0-12 




-2^ai2 


015 


021 


022 


023 


2^(1 - 022) 


O25 




032 


033 


-2^032 


035 




(1 - a22)/(2^) 


-023/(2^) 


O22 


-025/(2^) 


051 


052 


053 


-2^052 


O55 



Clearly Cq = StahG{vo). Recall that Q{v,w) = ^vJw. If y2 is the second and y4 is the 
fourth columns of the orthogonal group G, then they satisfy (5(y2,y2) = Qiy4:,'y4) = 
and Q(y2,y4) = Q(y4,y2) = l- The element gvo is the sum 26'y2 + y4. Hence, we have 

Q(2^y2 + y4, 2^y2 + y4) = 4^'Q(y2, y2) + 4^Q(y2, y4) + Q(y4, y4) = ^0. 

□ 

Remcirk. The sphere 5" is equal to 

S = {\xi, X2, X3, X4, X5) e V; 2x1X5 + 2x2X4 + xl = A9}. 



1.3. Double coset decomposition. In the spht case, we define 







/ 


1 
2 





1 

2 





















1 























-1 











1 

2 




1 


















1 










V 1 ) 






-1 





1 












In the non-split case {9 ^ (F^)^), we define 



/ 26 \ 




/ 


1 


1 















/ 


\ 









-1 




















26 





, 7o = 
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Note that vi — 7oi'o- 

Proposition 1.5. We have the disjoint decomposition: G = PCg U NAjoCg. The 
representatives of the N-Cg-orbits of maximal dimension, which is 9, are of the form 070, 
a & A. Futhermore, the map g 1— > qvq of Lemmas 1.1 and 1.3 establishes an isomorphism 
of homogeneous spaces from G/Cq to S. 
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Proof. Consider the left action of P on 5'. Since the last row of any element of P is 
of the form (0, 0, 0, 0, a 7^ 0, we conclude that there arc at least two P-invariant 

subsets in S: a closed subset {x = *{xi,X2,X3,X4,0); Q{x,x) = 1}, and an open subset 
{x = ^{xi, X2, X3, X4, X5); Q{x, x) = 1, X5 ^ 0}. We claim that P acts transitively on each 
of these two subsets. 

Consider the split case. The element Vi — *(l/2, 0,0,0, 1), which is a representative 
of the open subset. Acting first by an element from A and then from N, we obtain the 
transpose of 



When {xi,X2, x^) runs through and a over F^, this column runs through all elements 
X2, X3, X4, X5) of S, with X5 ^ 0. Thus P acts transitively on the open P-subset of S, 
i.e. it is a P-orbit. 

Consider the non-split case. The element Vi = ^{26, 0, 0, 1, 1) is a representative of the 
open subset. Acting first by an element from A and then from N, we obtain the transpose 



When {xi, X2, X3) runs through F^ and a over F^, this column runs through all elements 
) of S, with ^5 7^ 0. Thus P acts transitively on the open P-invariant 
subset of S, making it a P-orbit. 

Consider vq = *(0,0,1,0,0) in the split case and Vq = *(0, 26*, 0, 1, 0) in the non- 
split case. This is a representative of the closed subset. First, acting by an element 
n(0, —s, 0) & N (see I.l), in the split case, and n{—s, 0, 0) in the non-split case, we can send 
Vq to *(s, 0, 1, 0, 0) (respectively *(s, 26, 0, 1, 0)), s arbitrary. Multiplying it on the left by 
an element g = diag(l, m, 1) G M, we obtain *(s, m2i, ■0222, ""^23, 0), where *(m2i. ^22, "^132) 
is the second column of m. Thus, we obtain all elements ^{xi,X2, X3, X4, 0) G S. Note that 
the A/^-orbits in S of such elements are of dimension 1. 

Consequently, the decomposition of G with respect to P and Cg is G — PCq U P'^qCq. 
Recall that P = NAM. We assert that %^M^q C Cq. Indeed, from M C Stab('t;i) it 
follows that 7q"^M7o C Stab(fo), since vi = 70^0- Thus, G = PC U NA^jqC. 

Since A <Z Ce, we have PCe = NMCq. We have seen that the A^-orbits of NMCe/Ce 
are of dimension 1. Hence the N-Ge-douhle cosets of PGe are of dimension 7. 

We have seen above that the map g 1— > gvo is an onto map with kernel Gg. Consequently 
G/Go ^ S. The proposition follows. □ 



1.4. The subset KbiK. Set 61 = diag(7r ^,1,1, l,7r), 62 = diag(l,7r ^, l,7r, 1) and 
consider the double coset KbiK. Recall that F is the residue field of P, i.e. a finite field 




of 
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of q elements, q is odd. Define No = No(F). More explicitly 



n(xi,X2,X3,X4) = 
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where 2:4, Xg, 3:3, 3:2, ^2, x'^^, Xi satisfy the relations (2). Define in Nq the subgroups 
(the order of Ni is q^~'^): 

Ni = {n eNo; n = n{xi,X2,X3,0)}, 
N2 = {n eNo; n^n{xi,0,0,X4)}, 
Ns = {neNo; n = n(0,0,X3,0)}. 

We regard iVj and No as subsets of No(M) on choosing representatives in R of the elements 
of F = R/tt. 

The following Proposition is used in the proof of Proposition 1.8. 

Proposition 1.6. We have the disjoint decomposition 

KbiK = KbiNi U Kb2N2 U U Kb];\ (4) 



Proof. The Weyl group W = {1, (15), (24), (12)(45), (14)(25), (15)(24), (1452), (1254)} 
embeds in K, so we have 

KbiK = Kb^^K = KbiK = Kb2^K. 

Let Wi be the subset {1, (15), (12)(45), (14)(25)} of W, and Pi = KnbiKb^^ a parahoric 
(see, e.g., [T]) subgroup of K. Using the Iwahori decomposition: 



we have 



Kb:[^K = U^^w,Kb]:^PiwPi. 
Since b^^Pibi e K, this is equal to 

[J^(zWiKb^^wPi. 

Since Wi C K, and {w~^bi^w;w e Wi} is the set {6]^\ 61, 63 ^, 62}, we obtain 

Kb^^Pi U KbiPi U Xfe-^Pi U X62^'i. 
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In our analysis below, we use the decomposition Pi — N'MkAkNk, where A^' is the 
subgroup of with underdiagonal entries from ttR, = A (1 K, = N H K and 
Mk = M n K is the maximal compact of M = {diag(l, m, 1); m € SOlJ^)}. 

To describe the four double cosets, we introduce: 

Case ofKbi^Pi. Since bi^Pih C K, we have Kb^^Pi = Kb^K 

Case of KbiPi. Since biN'bi^ C K and M^Ak commutes with 61, we have KbiPi — 
KbiNK. 

The set of elements n G Nk with entries above the diagonal from 7ri? is a normal 
subgroup of Nk of elements satisfying binb^^ e K. Since the quotient of Nk by this 
subgroup is iVi, we have KbiNx = KbiNi. 

Case ofKb^^Pi. Since b^^N'b2 C K, we have Kb^^Pi = Kb^^MKNK- 
Let W2 be the subgroup of two elements {1, (13)}, where (13) is represented by the 
matrix W2 = antidiag(l, — 1, 1), and put P2 = Mk H 62^i<:^2^^- Using the Iwahori de- 
composition Mk = P2W2P2, our set is Kb2^P2W2P2NK- Since 62 ^-^2^2 £ K, this is 
Kb2^W2P2NK- But W2 = {1,^2} and W2&^^W2 = 62, so this double coset is 

Kb^^P2NK U Kb^^W2P2NK = Kb^^NK U Kb2P2NK- 

Subcase of Kb2^NK- If n e Nk is such that 63 ^^^^2 £ -f^, then n — n{xi,X2,X3,X4), 
where Xi,X2,X4 e R and X3 G ttR. The set of such elements is a normal subgroup of Nk- 
Since the quotient of Nk by this subgroup is A^3, we obtain 

Kb^^NK = Kb^^Ns. 

Subcase of Kb2P2NK- To simplify the notations, write m G GL(3) for diag(l,m, 1) G 
GL{b). Then P2 = U' A2U , where we put A2 = {diag(Q;, l,a^^);a G , \a\ = 1}, 

[ / 1 N ] 1/1 -y -\y- \ I 

U' ^ {\ -X 10 ;a;G7ri?>,[/=< 1 y ;yGi?>. 

I V - 1 y J I V 1 y J 

Since 62^^'^^^ C -fC and ^2 commutes with 62, the coset Kb2P2NK is equal to 

Kb2U'A2UNK = Kb2UNK. 

Note that C/A^i<: = A^o H Finally, any n E Nq such that 62^&2^ ^ is of the form 
n = n{xi,X2,X3,X4), where 2:2, 2:3 G R and Xi,X4 G Tri?. The set of such elements is a 
subgroup of No(-R), and A^2 is the set of representatives of its left cosets in No(i?). Thus 

Kb2P2NK = Kb2N2. 

Case of Kb2Pi. Decomposing Pi and using b2N'b2^ C K and 62^ii'&2^ = -^j 
we obtain 

Kb2Pi = Kb2N'AKMKNK = Kb2MKNK. 
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Applying the Iwahori decomposition to Mk, {W2 — {1,W2}), this is 

Kb2P2W2P2NK = Kb2P2NK U 7^62^2 W2P2A^i^. 

The double coset Kb2P2NK has already been considered. We are left with the double 

COSet Kb2P2W2P2N K ■ 

Since P2 = U' A2U and W2U' A2W2 C P2, we have 

P2W2P2 = P2W2U'A2U = P2W2U. 

Futhermore, since 62^'^2&2 ^ double coset Kb2P2W2P2NK is equal to 

Kb2P2W2UNK - Kb2U'A2UW2UNK = Kb2UW2UNK. 

Since W2^b2W2 — b2^ this is equal to 





Kb2W2W2^Uw2UNK = Kb^^UiUNK, where Ui ^ { { -y 1 \ ; y e¥ 

V y 1 

According to the Iwasawa decomposition, any element n e t/i can be written as n = 
UiSW2U2.i where Ui e C/, and s, the diagonal matrix, can be commuted across b^^ . Since 
W2^b2^W2 — &2, we have 

Kb2^UiUNK = Kb2UNK, 
obtaining again a coset which has already been considered. □ 

1.5. The i^-orbits of S. Under the action of K, the sphere S = {x e V; Q{x,x) = 1} 
can be decomposed as a union of open and closed X-orbits. The following Proposition is 
the special case of a more general statement (see [MS, Prop. 3.9]). 

Proposition 1.7. Set = diag(7r'', 1,1,1, tt^'^'). Each K-orhit of S is of the form KdrVi, 
r > 0. The element *(a;i, 0:2, 0:3, 0:4, 2:5) G S belongs to the K-orbit of d^Vi if and only if 

||x|| = max{|xi|, \x2\-i |x4|, \x^W is equal to q^. 

Proof. Consider the set KdrVi. If kj is the ith column oi k & K, then kdrVi is equal 
to |ki7r^ + ksTT"''. When k ranges over all elements of K, this sum ranges over all 
elements ^{xi,X2,X3,X4,X5) G S such that max{|a:i|, |x2|, l^aj, |x4|, |x5|} = q^, since the 
max absolute value of the entries of /cj is 1. □ 

Let (pr be the characteristic function of the X-orbit of drVi in S. Normalize the additive 
measure dx on F and the multiplicative measure d^x on (d^x = (1 — l/q)~^\x\~^dx), 
so that 

dx^l, and / d^'x ^ {1 - l/q)'^ FT = 1- 

Jr J\x\=1 J\x\=l pl 
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Normalize the measure on K so that its volume is 1. We need the following result. 
Proposition 1.8. The volume of the K-orbit of drVi in S is given by 

Ar^q''{lTq-')K if r>l, (5) 
where the "—" sign is in the split case and in the non-split case. 

Proof. Suppose r > 1. Let /i be the characteristic function of KbiK in G. Since the 
measure ds on S is invariant under the action of G, we have 

/ / 4>r{9s)dsfi{g)dg ^ / fi{g)dg / (f)r{s)ds. (6) 
JgJs Jg Js 

Using Proposition 1.6, and that #A^j = q'^~\ the right hand side of (6) is equal to 

(q' + q^ + q + l)Ar. (7) 
In the left hand side of (6), we change the order of integration. It is 

/ Ir.{s)ds, where = / (prigs) fi{g)dg. 

Js Jg 

Note that Ir{ks) — Ir{s) for any k e K. Thus it is constant on the K orbits in S. In 
particular, if s is in the X-orbit of diVi, we have Ir{s) — Ir{diVi). We obtain 

/ Ir{s)ds^J2^i^r{diVi). (8) 

Using Proposition 1.6, the value of Ir{diVi) is 

/ (t)r{gdiVi)fi{g)dg ^ / (prjkbindjVijdk + / (i)r{kb2ndiVi)dk 

+ y^ / (pr{kb2^ndiVi)dk + / (t)r{kb^^diVi)dk. 

Since 0^ is left X-invariant, the expression above is equal to 

(prihndiVi) + ^ (f)r{b2ndiVi) + ^ ^^(^2 ^^^^jVi) + 4>r{bi^diVi). (9) 

nGiVi nGiV2 nGNs 

We consider the contribution to (8) from each sum of (9). In each case we distinguish 
between r > 1 and r = 0. In some cases we consider the case r = 1 separately. 
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Case 1. Consider the contribution to (8) from the first sum in (9). In this case n E Ni 
and the element bindiVi, in the spht case, is equal to 
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In the non-split case the last vector column is 

*(2^7r\0,0,l,7r-*). 
These elements are equal to (spht/non-split cases respectively) 

\7r'-^/2 + z7r-^'+^\xi7r-\ x^t^'K x^tz-\ tt^"^), (10) 

\2eTz'-^ - XiTT-^ + ZTZ-^'+^\xiTT-\ X^T^'', 1 + XaTT"*, -K^''). (11) 

Depending on n, these elements belong to different /T-orbits of S. 

Let r > 2. Put n(a;i, X2, X3) = n(a;i, X2, X3, 0). We decompose the group A^i into a 
disjoint union as follows. 

(i) Let n — n(0, 0, 0) be the identity matrix. Then h\ndiV\ = bidiVi = di-iVi. Hence 
(t)r{hindiVi) — unless i — 1 = r (or i = r + 1). The contribution to (8) of this case is 

(a) Let n = n{xi,X2,X3) be a non-identity matrix with z = 0. We claim that there 
are (g^ — 1) such matrices. Indeed z = implies 2x1X3 -\- x^ = 0. The latter equation has 
q{q— 1) solutions with 2:3 7^ {x2 arbitrary) and q—l solutions with X2 = X3 = 0, Xi 7^ 0. 
Since z — 0, but n is non-identity, the element bindiVi belongs to the X-orbit of diVi. 
Hence (pripindiVi) = unless i — r. The contribution to (8) of this case is (g^ — l)Ar. 

(Hi) The remaining matrices n = n{xi,X2,x^) have z ^ 0. Since the order of A^i is 
q^, there are q^ — q^ such matrices. The element bindiVi is in the X-orbit of rfj+if 1 (since 
z ^ 0). The function (f)r{bindiVi) is unless i-|-l = r (or i = r — 1). Thus, the contribution 
to (8) of this case is (g^ — g^)Aj._i. The contribution from the cases (i), (ii) and (in) is 
(when r > 2) 

(g3 - + (^2 _ ;l)a^ + A^^^^ (12) 

Let r = 1. The only contributions to (8) occur when i = 0,l,2. Ifi = 2, the element 
bind2Vi (see (10)) is in the i^'-orbit of diVi precisely when n is the identity matrix. The 
contribution to (8) is A2. If i = 1, the element bindiVi is in the K-orbit of diVi when 
z — and n is a non-identity matrix. As we have seen above, the equation z — has 
— 1 solutions. The contribution is (g^ — l)Ai. If i = the element biuvi is 

*((l/2 + z)tv-\ Xi, X2, X3, tt), -xi + z),xi, X2, X3, Ott) (13) 
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(split/non-split cases respectively) is in the K-orbit of diVi when y^0oic29 — xi + Zy^ 
0. The equation 2; + | = is equivalent to 2xiX-i + X2 = 1, which has + q solutions. 
Indeed, there are q{q — l) solutions with X3 ^ 0, X2 arbitrary, and 2q solutions with x^ = 0, 
X2 = ±1, Xi arbitrary 

The equation 29—xi-\-z — (where z — —x\Xz—x\j2) is equivalent to 2x\{\+X'^+x\ ~ 
A9, which has q^—q solutions. Indeed, there are q{q—l) solutions with xi ^ 0, X2 arbitrary, 
and no solutions with xi = 0, since 46 is a non-square. 

Hence, this case contributes {q^ — q^ — q)-^o- So, when r = 1, we have 



{q'-q''Tq)Ao + {q''-l)A,+A2, 



(14) 



where the "— " is in the split case and "+" in the non-split case. 
Let r — 0. We distinguish between two cases: 

(i) Let n be the identity matrix, i.e. Xi — X2 — X3 — 0, and z — 0. The element 

hidiVi (see (10)) is in the /C-orbit of di^iVi. We have 0o(c^i-it^i) — unless i — 1. This 
contributes (in both split and non-split cases) Ai to (8). 

(a) Let n be a non-identity matrix. Since xi, X2i 0:3 are not all zeroes, (10) is the 
X-orbit of d-iV\. Hence (poid-iVi) = unless i = 0. Thus only i = contributes. This 
contribution occurs when binvi e Kv^. This happens (see (13)) when 1/2-1-2; = 0, in the 
split case, or 2^ — a:i + 2; = in the non-split case. The first equation has q^ + q solutions, 
the second one — q. Their contribution to (8) is q{q ± l)Ao. 

Thus Case 1, with r = 0, contributes to (8) the quantity (g^ ± g)Ao + Ai. 

Case 2. Consider the contribution to (8) from the second sum of (9). For n G N2, the 
element b2ndiV-i, in the split case is equal to 
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and in the non-split case, replacing (7rY2, 0, 0, 0, tt *) with (2^7r', 0, 0, 1, tt '), we obtain 



2^7r* — a;i,7r ^{xiTZ * — ^2:4), X4, tt, tt" 



For r > 1 in the split case and r > 2 in the non-split case, we have 

(i) If X\ = 0, the element b2ndiVi belongs to the /T-orbit of diVi. Since X4^ can be 
arbitrary, the contribution to (8) is qA^. 

(ii) li xi (there are q^ — q such matrices), the element b2ndiVi belongs to the K- 
orbit of rfj+i^i. We have (f)r{di+i) — unless i + 1 — r (or i — r — 1). Their contribution 
is (g2 - g)A,._i. 

Consider the non-split case with r = 1. The contribution occurs when i = 0,1. If 
i = 1, we have that xi = and X4 can be arbitrary. If i = 0, we have a contribution when 
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7^ 0, which has — q solutions. The resulting contribution is the same as in 
case r > 2. 

Thus, the contribution from this case (for r > 1) to (8) is (same in both split/non-split 

cases) 

{q^ - q)Ar-i + qAr. (15) 

Now let r = 0. First, consider the split case. If Xi ^ 0, the element b2ndiVi lies in the 
X-orbit of di+iVi. Hence there are no positive i for which b2ndiVi belongs to the X-orbit 
of Vi — doVi. If Xi = then h^ndiVi is in the X-orbit of diV\. We have 0o(c?i'i^i) — unless 
i = 0. Since xi is arbitrary, this case contributes gAo to (8). In the non-split case, the 
only contribution occurs when i = and 4 = 0. This case contributes gAg to (8). 

Case 3. Consider the contribution to (8) from the third sum of (9). For n e A^3, the 
element fe^^ndi^i is 
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in the split case, and in the non-split case it is 

(2e7r\ 0, 0, 7r-^(l + xaO, TT"*) . 

Consider r > 1. If = the element h2ndiVi lies in the X-orbit of diVi] otherwise it is in 
the X-orbit of (ii+iVi. Thus, the only contribution to (8) occurs when i — rori — r — 1. 
Since A^3 has q elements, this contribution (for both split and non-split cases) is 

(g-l)A,_i + A,. (16) 

If r = 0, the only contribution, Aq, to (8), occurs when i — Q and X3 = or X3 -|- 1 = in 
the split and non-split cases respectively. 

Case 4- The element b^^diVi is in the i^-orbit of (ij+iVi. When r > 1, it contributes 
the term Ar-i to (8). There is no contribution when r — 0. 

In all expressions below, the upper sign corresponds to the split case and the lower to 
a non-split case. 

Summing up, when r > 2, the sum (8) is equal to the sum of (12), (15), (16) and A^.i: 

q^Ar-i + {q'^ + q) Ar + Ar+l. 

In all expressions below, the upper sign corresponds to the split case and the lower to a 
non-split case. When r = 0, the sum (8) is equal to 

(g2 ± g)Ao + Ai + gAo + Aq = (g^ + 2g + l)Ao + Ai. 
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When r — 1, using (14) instead of (12), this sum is 

(g^ T q)Ao + {q^ + q)M + ^2- 

Hence, we obtained the left hand sides of the equation (6), for r > 2, r = and r — 1. 
Using (7), when r = 0, 1, we have 

(g^ T g)Ao + (g' + g)Ai + A2 = (g^ + + g + i)A,, 

(g2 + g±g + l)Ao + Ai = (g^ + g^ + g + l)Ao. 
The equations imply that 

Ai = (g^ ^ g)Ao = g=^(l T g-')Ao, and A2 = g^(l ^ g-2)Ao. 

For r > 2, we have 

g%_i + (g2 + g)A^ + A^+i ^{q^ + q'^ + q + 1)A^, 
namely A^+i — A^ = g^(Aj. — A^-i), or 

A^+i = (1 + q^)Ar - q^K-i- 
The proposition follows by induction. □ 

II. Correspondence of spherical functions. 

II. 1. Satake transform on the Hecke algebra of G. Let tt — IciCX') be the 
unramificd representation of G normalizedly induced from the character |ai|''|a2|'' of B. 
Define the Satake transform of a spherical function f on G (i.e. / G G^{G) and it is 
iiT-biinvariant) , by /^(tt) = tr 7r(/). Then 

7r(/)0o = r (7r)0o, 

where (pQ is the unique — up to a scalar multiple — X-fixed vector in the space of /g(C) CO- 
We fix 00 by 0o(l) = 1. 

Set TiQ = /g(Ci 1/2 + 0- We shall show in Proposition 2.2 below that there exists a 
unique X-invariant function on the sphere S, such that T^(l) 7^ and 

/ f{9)Td9s)dg = r{n^)T^{s). (17) 
Jg 

Applying (17) with s — 1, the Satake transform of any spherical function / on G is given 
on the TT^ by 

TK) = / M^)Td^)TSr'ds. (18) 
Js 
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Since is X-invariant, it will be defined by its values on the X-orbits of S, which 

are of the form KdrVi, where dr = diag(7r'', 1, 1, 1, tt"*") and r > 0. Set T^^^ = T(^{drVi), 
r > 0. These numbers are computed in Proposition 2.2. 

Put = Si=o 4>ij where 4>i is the characteristic function of the i^-orbit of diVi. Then, 
the function $r is the characteristic function of a subset of 5" defined by 

{\xi,X2,X3,X4,X5) e S; \xi\ <q'\l<i< 5}. 

The main goal of this subsection is to compute the integral ^r{s)Tc_{s)ds, r > 1. 

To compute the numbers T^^^, we need the following result. Recall that /i is the 
characteristic function of the double coset KhiK, where hi is diag(7r~^, 1, 1, 1, tt). 

Proposition 2.1. The Satake transform fi(n) at n = Ig{CX') of fi is 

fn^)-Q'%' + Q''-' + Q'-'' + Q-')- 

Proof. We follow [FM], Section F. Any G /g(C,CO satisfies 

(l)(nak) =(5B(a)^/2| ai{a)\''\a2{a)\'' (f){k), (19) 

where a — dia.g{a, P^^,a^^), and ai and Q2 are the simple roots of G = S0{5), 
defined by ai{a) — a/ (5 and a2{a) — (5. We have 

(7r(/)0)(/i) = / f{g)4>{hg)dg. 

JG 

Using the measure decomposition dg — 5B{o)~^dndadk and (19), this is equal to 

f{h~^nak)5B{o)~^^'^\ai{a)\^\a2{a)\'^ 4>{k)dndadk. 



No JAo JK 



Ff{a) = Ssia)-^^^ [ I f{k-^ank)dndk. 

JK JNo 



Then 

tr/(C,C';/) = 

'Ao 



Put 

Ff{a) = SB{a)-'/'f I 

JK JNo 

tr/(C,C';/)= / Ff{a)\a(3-'\^\(3fda. 

JAo 

When / is X-biinvariant, 

Ff{a) = 5B(a)-V2 [ f(an)dn. 

J No 

According to Proposition 1.6, the double coset KbiK is the disjoint union 

KbiNi U Kb2N2 U Kb^^Ns U Kbi\ 
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It follows that the integral F/^ (a) vanishes unless a is in the X-double cosets of 61, 62, &2 ^ 
or 6f ^. Further, = g^, (5b(&2) = (^b(&2 ^) = (^^(^'r^) = Hence 

Evaluating the characters cti, 0:2 at 61, 62, ^2 ^ ^^'^ *® obtain 



I 

J A, 



Since /i^(7r) = tr laiC, C'; fi): the proposition follows. □ 
We use Proposition 2.1 to prove the following: 

Proposition 2.2. The equation (17) has a unique solution satisfying Tq.c — 1; ^'^^ (7'^'^ 
r > 1), we have 



^nc - 2^ —7 ... 3 nr? 



where the sign occurs in the split case and "—" in the non-split case. 
Proof. By Proposition 2.1, the equation (17), with s = drVo and / = /i, becomes 

/ f,{g)T^{gdrVo)dg = q^'\q^ + q''^ + q-''^ + q-^)T,,^. (20) 

JG 

Since /i is the characteristic function of the double coset KbiK = KhiNi U ii'62-^2 U 

Kh2^N^ U Kb^^, and the function is invariant under whose volume is 1, the left 
hand side of (20) equals 

T^{bindrVi) + T^ib^ndrVi) + ^ Ti^ib^^ndrVi) + Ti;{bi^drVi). (21) 

neNi neN2 neNs 

We will compute each of the sums. 

To simplify the notations (in the proof of this proposition), we write T for and 
for Tr^(^. For more details see Proposition 1.8. 

Case 1. Consider the first term of (21). Put n(a;i, a;2, ^3) = n(a;i, 0:2, 2:3, 0). 
Let r > 1. In the split case, we have 

6in(a;i, X2, x^)drVi = ^{tz'^~^ /2 + ztz~'^'^^^\xitt~'^ X27^~^ , x^tt'^, 7t^~^). 

In the non-split case, we have 

bin{xi,X2, X3)drVi = ^{26tz^~^ — xitz~^ + 2:77^*'''^^-', xiTr"*", X2TT^'\ 1 + x^tt^'^ tt"*^^"'). 
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Consider the following cases: 

(i) Let n = n(0, 0,0) be the identity matrix. Then bindrVi — bidrVi — dr-iVi and 
T{hindrVi) = T{dr-iVi) = Tr-i 

(a) Let n = n{xi,X2,X3) be a non-identity matrix with z = 0. In Proposition 1.8, we 
showed that there are (g^ — 1) such matrices. The element bindrVi belongs to the i^-orbit 
of drVi. Hence, T{bindrVi) = T{drVi) — T^.. 

(Hi) The remaining — q^ matrices n = n{xi, X2, x^) have z ^ 0. The element bindrVi 
is in the i^'-orbit of dr+iVi. Thus, T{bindrVi) = T{dr-\-iVi) — T^+i. 

We conclude that for r > 1, we have 

J2 TibmdrVi) = (g^ - q^)Tr+i + {q^ - 1)% + r,_i. (22) 

Let r = (do = 1)- The element b\n{xi,X2.iX^)v\ is equal to 

*(7r"^(l/2 + z),xi, X2-, X3, tt), or *(7r"^(2^ - xi + z),xi, X2, 1 + xa, tt). 

in the spht/non-spht cases respectively. These elements are in the X-orbit of diVi if 
I + 2; 7^ or 2^ — a:i + ^ 7^ 0. Otherwise, they are in the K orbit of Vi. 

The equation j + z — has (f + q solutions, and 2^ — xi + 2; = has (f — q solutions. 
Thus 

T{b,nv,) = {q^ -q^T q)T^ + {q^ ± g)To. (23) 

Case 2. Consider the second term of (21). The element b2n{xi, 0, 0, X/^)vi is equal to 
*(7r72, xnz-^'+^\ 0, 0, TT""), or '{297^'' - x^ tt'^xitz-' - xl/2), x^, tt, tt"'') 
in the split and non-split cases respectively. 

Let r > in the split cases or r > 1 in a non-split case. We have: 

(i) If n = n(0, 0,0,^4) e N2 the element b2ndrVi is in the i^-orbit of drVi. Thus, 
T{b2ndrVi) = T{drVi) = T^. 

(a) If n = n(xi, 0, 0, 2:4) e N2 has xi ^ 0, the element b2ndrV\ is in the X-orbit of 
dr+ifi and T{b2ndrVi) — T(dr+i^i) = Tr+i. 

Since there are q matrices in (i) and — g in (ii), (for r > 0), we have 

T{b2ndrVi) = (g2 - g)T,+i + gT,. (24) 

n€N2 

Let r = 0. The element 62^1^1 is in the /T-orbit of diVi if Xi — ^xl 7^ (g^ — g cases), 
otherwise it is in the K-orbit of Vi. The contribution is the same as (24). 

Case 3. Consider the third term of (21). 
Let r > 0. The element 63 ^^(0; 0; ^3; 0)'^i is equal to 

*(7r72, 0, 0, a;37r-("+^), TT-"), or *(2^7r", 0, 0, 77^^(1 + a;37r-")7r-'') 
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in the split and non-split cases respectively. This element belongs to the X-orbit of drVi 
if n is the identity matrix, and is in the X-orbit of dr+iVi in the remaining q — 1 cases. 
So, (for r > 0), we have 

T{b^^ndrVi) = {q- l)T,+i + T,. (25) 

neNs 

Case 4- Since bi^dr = dr+i (r > 0), the last summand of (21) is 

T{b^'drVi) = Tr+i. (26) 

Adding (22), (24), (25) and (26) we obtain that (when r > 1), the sum (21) is equal 

to 

q^Tr+i + {q'' + q)Tr + Tr-i. 
When r = 0, adding (23), (24), (25) and (26) (used with r = 0), the sum (21) is 

{q^Tq)Ti + {q'' + q±q + l)To, 

where the upper sign occurs in the split case and the lower in the non-split case. Both 
expressions should be equal to the right hand side of (20). Thus, we obtained two difference 
equations 

q^Tr+i + (q^ + q)Tr + T,_i = gi(g« + + g'^ + g-f)T„ 

and 

(g3 T q)Ti + {q^ + q±q+ l)To = gi(g^ + q^ + q'^ + g-^)To. 
The first one can be simplified to 

q^Tr+^ - qi {q^ + q-^)Tr + = (27) 

In the second one we assume Tq = 1. Then 

T, = <l^^<l' + <r')^<l-\ (28) 
The general solution of (27) is given by 

Tr = Ci\\ + C2A2, 

where Ai and A2 are the two roots of the quadratic equation 

g^A^-gi(g^ + g-'^)A + l = 0, (29) 
and Ci, C2 are chosen to satisfy two initial conditions: 

1 = ci + C2, and Ti = ciAi + C2A2. (30) 
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The solutions of (29) are Ai = g X2 — q ^ and that of (30) are 

T1-A2 (gi+<-i)(iTg-^-0 



Cl 



Ai — A2 {q'' — q~''){q^ T Q 2)' 

Ai-Ti ^ (gi-^-l)(lTg-^+9 

Ai — A2 (?^ — ?~^)(?^ T ?~^) 
The proposition follows. □ 

The main result of this subsection is: 

Proposition 2.3. Set X ^q^. Then 



I; 



1 X^'+l -X^^^'+l) l._l^X'■-X-^ 

^ x-x-1 x-x-1 



where the "— " si^'n is m t/ie sp/zt case and the "+ " in the non-split case. 
Proof. We have 

f ^r{s)T{s)ds ^ [YI Ms)T{s)ds = J2 TkK- (31) 

■^■^ ''^ k=0 fe=0 



Recall that Tq — 1 and assume that Aq = 1. In the computations below, the upper sign 
occurs in the split case and the lower in the non-split case. Using Propositions 1.4 and 
2.2, we have that, the sum (31) is equal to 

^ ^ {qiX-l){l^q-hx-^) ^ 3,^, _ {qlx-^-l){l^q-hx) ^ 3,^_, 
qHX-X-^) ^ qliX-X-^) ^ 

Using the summation formula for geometric series, and then simplifying the result we 
obtain the formula claimed in the proposition. □ 

II.2. The group H. Recall that H = PGL{2,F), and tt^ = lH,xoiC,-C) denotes the 
representation of H, induced from the character diag(a, l)n 1-^ lal^XolQ-) of B', where 
Xo is 1 or the unramified character of , whose square is 1. We denote the elements 
of PGL{2,F) by their representatives in GL{2,F). The Bruhat decomposition of H is 
H^B'U N'wB', B' = N'A', where A' = {diag(a, 1); a e F>^}, 

The character ip' of A^' is defined by ■il)Ni{n{x)) = iIj{x). 

Let Wi^ be the normalized unramified Whittaker function in the space of representation 
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TT^. It satisfies W^{e) = 1, W^{ngk) = ipN'{n)W^{g) {n' eN',ke K' ^ PGL{2,R), the 
standard maximal compact subgroup of H), and for any /' e C^{K'\H/K'), also 



Jh 

In particular, when h = e we have 

r «) = / /'(:r)Wc(^)rf^- (32) 
Jh 

Since dg^ = \a\~^dndadk, where a — diag(Q;, 1), \a\ — \a\ and da — d^a, we obtain 

/ f{nak)W^{nak)\a\-^dndadk 

= 11 f{na)i^N>{n)dnW^{a)\a\-^da^ I (t>),{a)W^{a)\a\-^da, 

J A' Jn' J A' 

where 

<P'f'{9) = / f'{ng)2pN'{n)dn. 



N' 

The function 0^, lies in the space Cc{N'\H / K'.ipNi) of the right i^'-invariant, compactly 
supported modulo A^', functions (j)' on which satisfy (p'{ng) — ipj^,{n)(f)'{g). For any 
integer r > 0, define 4>'j. by 

, a \\ ^ r 1, if |a| 
'^MVOlii lO, otherwise . 



Proposition 2.4. 

r/ie set {0;;r > 0} is a basis of Cc{N'\H / K'^^jn') ■ 

(2) For any (f)' E Cc{N'\H / K'^^jn,) , we have 0'(diag(a, 1)) = Q if \a\ > 1. 

(3) As in Proposition 2.3, put X = q^. Then 

ji^r+l _ V-{r+l) 

<P',{a)Wc{a)\a\-'da = {-lYqr- ^ . 



X -X 

Proof. (1) This is clear. 

(2) Indeed, choosing n E such that |n| = \a\, we have 



This is 0'(diag(a, 1)), since 0' is right K' invariant. But i/jn' has conductor R, hence 
ipN'{n) 7^ 1 for some n, and our claim follows. 
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(3) This follows from the definition of 0^ and Shintani's explicit formula [Sh] for the 
Whittaker function (cf. [F], p. 305) of Ih,xo{C: ~C): which asserts that 



□ 



II. 3. The correspondence. Put tt^ = Ig{C, 1/2 + C) and tt^ = ^h,xo{C, —()■ Following 
[FM], we say that / G C{K\G/K) and /' G C{K'\H/K') are corresponding li /^(tt^) = 
/'^(tt^). By (18) and (32), an equivalent definition is given by 

/ (t)f{s)T(^{s)ds= I 4>'^,{a)W^{a)\a\-^da. 

Js J A' 



Definition. Define a map : C^{K\S) Cc{N'\H/ K'.iI^n') by .^(0) = 0' if 

(j){s)T^{s)ds = / (j)'{a)W^{a)\a\-^da, 

Js J A' 

where is the X-invariant function on S, defined in II. 1 and Proposition 2.2, and is 
the unramified normalized Whittaker function defined in Section II. 2. 

Proposition 2.5. The map T is well defined and induces a linear bijection between the 
spaces C^{K\S) and Cc{N'\H / K', ipNi) , given by the correspondence (r > 0) 

.F($.) = (-i)v(0;±0;-i), 

where the "+ " sign occurs in the split case and the " sign in the non-split case. 

Proof. This follows from Propositions 2.3 and 2.4. □ 

Corollary. If / and /' are corresponding spherical functions, then J-'{4>f) = 4>'ff. 



III. The Fourier coefficients of orbital integrals. 



III.l. The Fourier coefficients of orbital integrals on H. As usual, F is a p-adic 
field, and x is a complex valued character of with conductor m, m > 0. Thus if m > 1, 
this character is trivial on 1 + tz^^R and is non-trivial on 1 + 7r"^~^R. If m = then x 
is trivial on and is non-trivial on 1 -|- tt^^R, and we say that x is unramified. Recall 
that {0;; r > 0} is the basis of C^{N'\H/K\ i/jn'), and for any 0' G C^{N'\H/K\ Vjv), we 
defined 

= X. *' ( ( -1 J ) ( 1 ) ( ° ) ) '''' 
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Definition. For any r > 0, set 

^'rix)= [ {9,a)ij{a)x{a)\a\<If'{a-\cf>'^)d''a. (34) 

J FX 



Proposition 3.1. Let x be a multiplicative character of . If x is unramified, define ( 
and XbyX^ |7r|-^ = x(7r)"^ Then 



is equal to if x is ramified, and is equal to 

X-"" ± qX^-"" 

if X is unramified. 

This proposition follows from the following Proposition : 
Proposition 3.2. The integral 



K{x)= / {9,a)^{a)x{a)\a\<^'{a \(P',)d''a 

J FX 

is equal to 

^-^^^'1^> 1^ + ^^^^ {q-l){lTqXy 
in the split and the non-split cases respectively, if x is unramified, and to 



ip{x)x{x)d^x 

x\=q"^ 



2{-lYq"^T{iP,x), where t(V^,x)= / 

if X is ramified with conductor m. 

Let us show how Proposition 3.1 follows from Proposition 3.2: 

Proof of Proposition 3.1. If x is ramified, the result is obvious. If x is unramified, using 
the result of Proposition 3.2, we have that 

(-i)v(*;(x) ± *;-i(x)) 

is equal to (in the split/non-split cases) 

l±qXT{qX±{qXf) ^ I - {qXf ^ 

l^qX l^qX ^ ■ 
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□ 



To prove Proposition 3.2, we need the following self contained Lemmas: 

Lemma 3.3. Let ip be a character of F with conductor R and x o-n unramified character 
of , where F is p-adic field. Set |7r| = and x{'^)~^ — Then for any x e F^ , 
we have 

{0, if > q'^\x\~^, 

-{q - if q^ = q\x\-\ (36) 

{q^Xf, if q^ < \x\-^. 




Proof. Recalling that d^a = (1 — 1/q) '^\a\ ^da, and that if \a\ — q^ then x(q;) = X^, 
we obtain 

/ \a\^il}{ax)x{a)d''a = (l - -) ^q^^X^ f ^{ax)da. 

J\a\=q>' ^ Q'' J\a\=ql' 

Put P — ax. The latter integral is 

(l - -) \^^X^\x\-^ f ilj{p)dp. 

^ J\P\=qk\x\ 

Recall that 

„ f 0, if / > 2, 

/ ij{P)dp^{ -1, a 1 = 1, 

•^1/31=9' [ (1 - if / < 0. 

The lemma follows from this if we note that if Z = 1, i.e. q'^lxl = q, then 

q'"'X''\x\-^ = -{q^X)K 
Q 

The other cases are obvious. □ 

Lemma 3.4. The same notations as in Lemma 3.3, hut let x be a ramified character with 
conductor m, m>l. Then 

/ tjj{x)x{x)d^x 

J |a;|=q'^ 

is equal to unless k = m, in which case we denote it by T{ip, x). 

Proof. We will consider two cases: k > m and k < m. 

Case 1. Consider the case k > m. In this case, there exists an element y E F^ , such 
that \y\ > 1, 1 + yx~^ G 1 + tt'^R and t/j{y) ^ 1. For such y, we have 

x(l + 2//a;) = 1, \x^y\ = \x\. 
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The change of variables x ^ x + y, gives 

/ ip{x)x{x)d'' X = / ip{x + y)x{x{l + y/x))d''x^ip{y) / ip{x)x{x)d'' x. 

J \x\=q'^ J \x\=q'' J \x\=q'^ 

This is since ip{y) 7^ 1. 

Case 2. Consider the case k < m. In this case, take an element y E I + 7r™i? (thus 
ip{y) = 1, \xy\ = \x\) such that xiu) 1- Set y' = y — 1. Since \xy'\ < 1, we have 

ip{xy) = ip{x + xy') = ip{xy')ip{x) = ip{x). 

The change of variables x ^ xy, gives 



/ ip{x)x{x)d''x = / %l){xy)x{.xy)d'^x = xiy) / i!{x)x{.x)d'^ x. 

J \x\=q^ J \x\=q^ J \x\=q^ 

This is 0, since x{v) 1- The lemma follows. □ 



Proof of Proposition 3.2. The integral is given by the integral 

€{{ \ \M\ ^rVn ^,\]{e.cx)x{a)i{a)^l^{a)\a\d-ad-a, (37) 




'F-JF- \\ 1 y V 1 y V 1 / / 

where t(a) = Xo(a) in the split case and is 1 in the non-split case. By matrix multiplication 

1 )\q i) = \Q 1 )■ ^^^^ 

We will consider two cases. 

Case 1. Assume that |Q;~-'^a~^| < 1 or \a\ > \a\~^. Using (37) and the property of 



In PGL{2) this is equal to c/)^ 1 ' ^ unless |a| ^ = g ^ or \a\ — q^. 

Hence, the integral (37) is equal to 

/ i{a)d^a j {d,a)x{oc)'^{a)\a\d'^a^ i''{'K)^^ / {9,a)x{oi)'^{oi)\o\d^a. 

J\a\=q^ J\a\>q-^ l^_j.J\(x\=ql 

(39) 

If X is unramified, we apply Lemma 3.3 with \a\ instead of \a\^ and x = 1: 



I- [0, if / > 2, 

/ x(«)V'(«)|aM''a= ^ -^(l-l/^)"^ in = l, (40) 

•^H=9' [ {qX)\ if/<0. 

30 



Puthermore, in the split case {9, a) — 1, and in the non-spht case {9, a) — (—1)' if \a\ — qK 
So, the sum (39) is equal to 

q — i- i=FgA ? — J- 

If X is ramified with conductor m, then according to Lemma 3.4, the integral (39) is equal 
to 

(-l)T / x(«)V'(«)c?"« = (-l)^rr(^, X)- 

J|a|=qrm 

Case 2. In this case, \a\ < \a\~^. Note that 

l\/la-M/aO\_/0 1 
-10y\0 1 y'V0 1y'~\-a -a-i 

In PGL{2), we have 

1 W \ _ / -a \ _ / 1 -a \ / \ / 1 

-a -a-^ [ -a / ~ I aa 1 / ~ I 1 i I 1 / I aa 1 



Hence, 



1 \ f 1 a-^ \ f a W aa^ 

-10 1 1 =^(")'^'- 1 



(42) 



The integral (37) reduces to 

V'(a)0r (^(^ J ^(«)(^>«)x(a)V'(a)|Q;M^Q;d^a. 
This integral does not vanish precisely when |aQ!^| = g"'". Thus, it is 
/ / L{^a){9,a)x{<y)i'{oi)\oi\d^Oid^a. 

i|a|<|a|-i i|a|=q-'-|a|-2 

Set \a\ — q^ and |a| = q^. The above integral is taken over the set Z < — s, s -\-2l — —r. 
Equivalently, this set is defined by I > —r, s = —r — 2l. Applying (40) to (42), the integral 
is a finite sum (split/non-split cases respectively) 

^'■(tt) Y1 I {0,a)x{a),p{a)\a\d-a = {^If ^ (±gX)' + {^ir'^ 

l>-rJ\-\=l' l=l-r 

if X is unramified, and to {—lYq"^T{ip,x) if X is ramified. Using the summation formula 
for geometric series, the unramified case is 



{±qX)-^-l q-1 iTqX q-1 
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Combining this expression with (41), we obtain the final result (for the unramified case) 



lyXqX)-'^ +{TlY-\X , {-iy-\qXy-'- + {TlY~'qX 2qX 



+ 



iTqX iTqX q-1 

Once simplified, it completes the proof of the Proposition 3.2. 



□ 



III. 2. The Fourier coefficients of orbital integrals on G. Recall that for any 
(f) e C^{K\S) and = diag(Q;, 1, 1, 1, a~^), we defined 



{naa'yoVo)'4^Nin)dn. 



N 



For any e Cc{K\S), the Fourier transform ^^(x) of ^(a, (f)) is given by 

J FX 

Recall that $r = X^[=o^«' where (pi is the characteristic function of the i^-orbit of diVi. 
In this section we compute 

where x is the same character as in Section II. 

Proposition 3.5. In the split case, the Fourier transform ^'r-(x) ^/^'(q;,^^) is equal to 

qX^-"- + X-"- 

if the character x is unramified, and to if x is ramified. 
Proof. Recalling the definitions of a, n, 70 and vo, we have 



^(Q;,$r) = JJJ ^r(oi/2 + z/a,Xi/a,X2/oi,X3/a,l/a)'ijj{x2)dxidx2dx3. 

Recall that ^r{xi, X2, X3, X4, X5) is 1 if \xi\ <q^{i — 1, ...,5) and is zero otherwise. Thus, 
the integral ^r(x) is equal to 




x{oi)%l){x2)dxidx2dx^d^ a.. 



(43) 



over the set defined by 



a z 
2^ a 



a 



X2 

a 



X3 
a 



<q'\ 
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where z — —x\x-i — x\/2. After the change of variables Xi i— > axi, the integral (43) is 
equal to 

\a'fx{'^)'^{'^X2)dxidx2dx^d^a^ (44) 




1-1 



over the set 

\a{l — x\ — 2x1X3)1 < q^, \xi\ < q^, \x2\ < q^ , l^s] < q^ , q~^ < \a\ 
Fixing xi, X2 and X3, we obtain that 

q~^ < \a\ < q^\l — X2 — 2x1X3] 
Changing the order of integration in (44), it is equal to 

/ / / / 

First, assume that x is ramified with conductor m. By Lemma 3.4 

x{o()ip{o()d^a 



y\<q'^\l-xl-2xiX3\-^ 



\a\^x{^)'4'{^X2)d^ adx2dx3dxi 



(45) 



/ 



vanishes unless k = m. Thus 



\a\^x{aytp{ax2)d''a = q^"'T{ij,x)\x2\ ''\ '(xs). 



-3,-1/ 



\a\=q^ 

Since, for any the integral of X~^{x2) over \x2\ = q^ is equal to 0, we conclude that 
^r(x) = when x is ramified. 

Now, let us consider the case of an unramified character x- To apply Lemma 3.3, we 
need to split the domain of integration over a into two domains: defined by condition 
q'"/\l — 2x1X3 — xl\ is < 1/1x2! > Vkzl- We will consider the contributions of the 
integral (45) over each of these domains. There are two cases. 

Case 1. Let us consider the contribution to (45) from the first domain, namely — 
2x1X3 — x|| < l/|x2|. Equivalently, it is 



1 — 2x1X3 



X2 



- X2 



(46) 



In this case there arc two subdomains. 

Case la. The first subdomain is |x2| = q''. Since \xi\ < q^', we have |1 — 2x1X3] < g^''. 



which implies 



1 — 2x1X3 

X2 



- X2 
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This is equivalent to |1 — 2x1X3 — = \x2\q'^ — q ■ Note that since r > 1, we have 
|1 — 2x1X3— a;2| = I2X1X3+X2I. Hence, we conclude that in the integral (45), the integration 
over a is taken over \a\ — q~^ ■ Applying Lemma 3.3, 



\<y\=q-' 



The integral (45) is the product of (g^X) and the volume of a subset defined by 

{|xi| < q\ |X2| < (i\ IX3I < (f, |2xiX3 + X2I = (i'}. 
This subset is equal to 

{IX1X3I < c^''~} IX2I = g*"} U {|xi| = IX3I = (f, Ixal = q\ |2xiX3 + X2I = c^''}- (47) 
The volume of the first subset is 

/ [ + f / 1 ^^^3^2:1 / dx2 = (1 - -) (2 - 

J \xi\<q-' J \x3\<q'- J \xi\=q'- J \x3\<q-' } J\x2\=q'' ^ 

The volume of the second subset of (47) is the integral 

III dx2,dx2dxi= (l--\q^ 

J\xi\=qr J\x2\=q'- J\x3\=q'-,\2xiX3+xl\=q^'^ ^ 0^ ^ 0/ 



,3r 



q' 



Multiplying the volume of (47) by {q^X) '', the contribution of (45) from the subcase la 
is: 

/ 1\/ 1\1 / 1\2/ 9\ 

(45 



q/ \ q/ q \ q/ \ q^ 

Case lb. The second subdomain is defined by |x2| < g''. In this case, we have 

1 — 2xiX3 



X2 



X2 





1 — 2X1X3 




X2 



Hence, in the integral (45), the integration over a is performed over 



q~'' < \a\ < 



q' 



1 — 2x1X3! 



and X2 satisfies {|x2| < |x2| < |1 — 2x1X3 |g~''}. We will consider two cases: |1 — 2x1X3] = 

and |1 — 2,i:i,T3| < g^*^'. 

(i) Let |1 — 2x1X3! = g^*". Since |xj| < q^', this implies that |xi| = |x3| = q^' . The 
integration (in (45)) is taken only over a with \a\ = q^^', and over X2 with |x2| < g*". Thus 
the integral (45) is 



I a I ( q; ) ( q;X2 ) Q;dx2 dx3 dx 1 . 



|a;i|=g'' J \x3\=q'' J [x2\<q'~ J \a\=q 
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Once evaluated and simplified, it is 



(i--)VyV^)-^=(i--)'-^ 



(49) 



(ii) Let |1 — 2x1X3! < gf^^. Define Z by |1 — 2xiXs\ — g'. In (45), X2 is bounded from 
above by |1 — 2xiXs\q~'^ — q^~'^. Since Z < 2r — 1, this impfies that X2 < ■ The integral 



(45) becomes 

/ / / / 



\xi\<q'^ ''\x3\<q^ J \x2\<\l-2xixz\q ' J q 

Breaking it into the sum over Z, it is 



\<q^\l-2xiX3\-'^ 



\otf'x{ot)ip{ax2)d^ OLdx2dxzdxi. 



^11 



l<2r-l'' ''\^^\<<f^^3\<<f^ \l-2xiX3\=q'' J \x2\<q' 



I I 

J\x2\<q''-^ ') q~^<\a\<q'^ 



I a I ^ X ( a ) ( a a; 2 ) (i ^ a (ia; 2 (ia; 1 da; 3 



(50) 



Applying Lemma 3.3, the integral over a becomes a geometric series 'YJ]^=-r ■ Sub- 



stituting this into the integral over a;2 in (50), we obtain 



/ 



'\x2\<q^-' ~ 1 

Hence, the integral (50) is equal to 



-dx 



^11 

^n- 1 \X 



q^X - 1 
q{q'Xy+' 



iq'X)-^- 



q^X - 1 



q ■ 



q^X-1 



iq'xy 



l<2r-l " •^Nll<9^ \x3\<<f, 11-2x1X31=9' 

Sphtting ofi^ the term corresponding to / = 2r — 1, it is 



q^X-l' 



dxidxs 



-{q'X + iyq'X)-^ 1 1 

q J J\xi 



dxidxs 



(51) 



|zi|<(;'", \x3\<q'~, \l—2xiX3\=q^ 



+ E 



l<2r-2 



q^X - 1 ^) 



dxidxs- (52) 



This is a contribution of (45) over the domain Ib(ii). Wc will not evaluate the sum (52) 
any further for it will be cancelled by a similar sum obtained below. 

Case 2. Consider the contribution of (45) over the domain — 2a;ia;3 — a;2| > l/|a;2|- 
Equivalently, it is 

1 — 2x1X3 



X2 



- X2 



<q'. 



(53) 



Using Lemma 3.3, the integral over a in (45) can be split into two integrals: one over the 
subdomain g^"' < \a\ < |x2|~^ and the other one over the subdomain \a\ = g|x2|~^. Thus 
the integral (45) is 




q-'-<\a\<\x2\-'^ J \a\=q\x2\-'^ 



\a\^il!{ax2)x{<^)d^ 0(dxidx2dx3, 



(54) 
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where xi, X2 and range over the set 



1 — 2x1X3 



X2 



X2 



(55) 



Define / by |1 — 2x1X3! = g'. We distinguish between the cases / < 2r — 1 and / = 2r. 

Case 2a. Assume that |1 — 2x1X3! = < g^*", or / < 2r — 1. Since !x2! < g*", the 
condition (53) cannot be satisfied for / = 2r — 1. Hence / < 2r — 2. Furthermore, (53) 
imphes that !l — 2xiX3!g~^ < !x2! < ■ Hence, the set (55) is 



Set !x2! = g''^. By Lemma 3.3, we have 



|1 - 2X1X3! I ^ r-l 

— < X2 < g'^ . 



I 1^ k=—r 



(56) 



q^X-1 



The other integral over a in (54) is 



J \a\^tlj{ax2)xHd''a = -(^1 - 1) 'q'^Xq-^'^X-'^ = - X {q^^ X)' 



|a|=9|a;2| 1 

Summing up the last two integrals and simplifying the result, the integration in (54) over 
X2 is 

q'X{l-q'X) , {q'Xy 



I 



ql-r+l<\x2\<q^~'^ 

This integral is equal to 



(g3X-l)(g-l) 



(q'X)-^^ - 



q^X - 1 



dxo. 



/ IX q'X{l-q^X) ^ / 1 . Ix (g^X)- ^ 

V q) {q^X -l){q-l) ^ Kq'^x) \ q)q^X-1 ^ 

T\ — / r-|-l 



g/g3X 



Once simplified, it is equal to 
1 



-^{iX^\){q^X)-^ 



2 v^'■+l 



q^X-l 
Hence, the integral (54) is 

kq^X+l){q-Xr II 



iq'xr + 



q^X-l 



ri=l—r+l 



q 



dxidx^ 



(57) 
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- E 



l<2r-2 



q{q^Xy+' 
q^X - 1 



q^X-l' 



a 



dxidxz- (58) 



xi\<q'^,\x3\<q'^,\l-2xiX3\=q^ 



The sums (52) and (58) cancel each other. Thus, the sum of the contributions of Case 
Ib(ii) and Case 2a is obtained on adding (51) and (57). It is 



dxidxz- 



l<2r-l " " l^ll^'J'"' |a;3|<'j'', |l-2a:ia;3|=(j' 

The sum of the integrals in this expression is the integral 



dxidxs 



|a;i|<9% |a;3|<g% \l-2xiX3\<q'^ 



/ dxi j 


1 dxs + 


/ dxi I 






' \xi\=q^ J\ 



dx^^q^'-\2-l/q). 



\x-A\<q'''^^ 

In conclusion, the contribution from Case Ib(ii) and Case 2a is 



-(g^X + l)(g^X)-V'-^(2-i). 



q \ 
Case 2b. Now |1 — 2x1X3 1 = q^^. Since \xi\ < q'^, this implies that 



F3 



(59) 



Futhermore, to satisfy (53), we must have that \x2\ = (f ■ Since in this case the inequality 
q'"^ < \a\ < \x2\~^ is equivalent to \a\ — q"'^, and g|a;2|~^ = the integral (54) is equal 
to 

I Q! I ^ -0 ( q; X 2 ) X ( Q! ) (i ^ a (ix 1 fix 2 (ix3 . 




+ 

'\a\=q-r J\a\=q^-r 

where Xi, X2 and X3 range over the set 



Fi| = q , F2I = q , F3I = q 

Since |x2| = q^, using Lemma 3.3, we have 



1 — 2x1X3 



X2 



- X2 



<q 



r-l 



(60) 



(61) 



/ \a\^ilj{ax2)x{oi)d''c( = {q^X) 

J\a\=q-'~ 



and 



/ 



\a\^ip{ax2)x{'^)d^ C( 



3 



(q'x) 



q-1 



(62) 



(63) 



\a\=q^-^ 

The volume of the set (61) can be computed as follows. The inequality (53) is equivalent 
to 

1 — 2x1X3 — X2 = 7r^~''ix2, where \t\ < 1. 
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Thus, the set (61) can be described as 

\xi\ = q\ \X2\ = q\ X3 



1 — x\ X27r^ 



2xi 2xi 

Note that l^al = q'' and dx^ = q''^^dt. The volume of (61) is 



t, \t\ < 1. 



J\xi 



dxi I dx2 / dt 

\=q^ J\x2\=q'- ''\t\<'^ 



1 N 2 

1 - -) q''-\ 
qJ 



Multiplying this by the sum of (62) and (63), the integral (60) is 



{q\X 



1-7- 



9-1 



3r-l 



Hence, the contribution to (45) of Case 2b is 

1 / 1\2 

-(1--) X-^-{q-l)X 



l-r 



(64) 



We have considered all possible cases. Finally, the answer (the integral (45)) is ob- 
tained on adding (48), (49), (59) and (64). □ 

Proposition 3.6. In the non-split case, the Fourier transform ^'r(x) of^{a, $r) 'is equal 
to 

X-'' - qX^-'' 

if the character x is unramified, and to if x is ramified. 
Proof. Recalling the definitions of a, n, 70 and vq, we have 




F3 



^r{2a9 — xi + z/a, xi/a, 0:2/0;, 1 + 0:3/0;, l/a)ip{xi + 26x3)dxidx2dxz. 



Hence, by definition the integral ^r{x) is 

/ / $r(2o;^ — xi + z/a, Xi/a, X2/oi, 1 + xs/a, l/a)'4>{xi + 29xz)dxidx2dx3x{'^)d^ oc- 

Recall that $^(2:1, 2:2, 2:3, 2:4, 2:5) is 1 if \xi\ < q'' {i = 1, ...,5) and is zero otherwise. Thus, 
the integral above becomes 



JJJJ ^^'^^^^'^^ ~'~ '^^^3)d'Xidx2dx2d^ a, 



over the set defined by 



2q;6I -Xi + - 




Xi 




X2 


<q\ 


1 + — 


<q'\ 


1 


a 




a 




a 
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where z — —x\x-i — x|/2. After the change of variables xi i— > axi followed by ^3 i— > 1 + X3 
we arrive at the integral 





\a\ '4}{pl{x\ + 1Q{xz — l))x(Q!)(i^Q!(ia;i(ia;2(ia;3 (65) 

over the set given by 

\xx\ < g^ \x2\ < g^ 1x31 < g^ q-' < \a\ < q'\2 + ez\-\ (66) 

where z — —XiXs — x\/2. By Lemma 3.3 

p r 0, if > q^\x\~'^, 

/ \a\^ip{ax)x{a)d''a= I -{q - l)-\q^Xf, ii q'' = q\x\-\ (67) 
•^H=9' [ {q^Xf, if q^ < \x\-\ 

In order to use this, we will split (66) into two subdomains: according to whether q^ /\2-\-0z\ 
is < or > than l/\xi + 29{x2, - 1)1- 

Case 1. We have q^ /\2 + 9z\ < l/\xi + 2^(2:3 — 1)|. Using (67), the integration over a 
in (65) is performed when q~'^ < \a\ < q^\2 -\- 9z[''^ . The integral (65) is equal to 

I a 1^-0 (a (xi + 2^(a;3 — l))x{cx)d^ adxidx2dx:i^ 
where the triple integral is taken over the set defined by 

kl|<g^ k2|<?^ k3|<g^ \x^ + 2e{x^-i)\<\2 + ez\q-'. 

Define I hy \2 + 9z\ = q'' . The integral above can be writen as 

^'i^ l / \afilj{a{xi + 2e{x3- I))x{a)d''adtdx2dx3, (68) 

where (for each /) xi, X2 and X3 range over the set 

\xi\ < \X2\ < \xs\ < 12 + ez\ = q\ \xi + 2e{xs - 1)1 < (69) 
Applying (67), we obtain 

» r—l 

/ \afilj{a{xi + 2e{x3 - l)))x(a)d^a = i'i^^)'' 

Jq-'-<\a\<qr-l 

_ (g3^)r-;+l _ (g3^)-r 

~ q^X-l ■ 
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(70) 



Making the change of variables in (69), xi — 29(1 — X3) + tt^ H, where \t\ < 1, the sum 
(68) is equal to 

Evo.(y.(o),- '^°^';t;:r''^ (71) 

l<2r ^ 

where Vi{l) is the set defined by 

\t\ < 1, \X2\ < q\ \X2,\ < q\ \A-e^ - 2^7r"-'te3 + (2^X3 - Of - Ox^ = qK (72) 

Note that since jxa] < q^ and \t\ < 1, we have |2^7r''~'te3| < g'. We distinguish between 
the following subcases. 

Case la. Assume that \26'k'''~Hx3\ = qK It follows that \t\ = 1 and l^sl = q'^. This 
subset of (72) is given by 

\t\ = 1, \X2\ < q\ |X3| = g^ \A-e'^ - 2en''-hx3 + {26x3 - Of - OxH = q^. (73) 

Since ^ is a non-square element and \x2\ < , \{29x3 — Oy — 6xl\ = q^^ . Thus the only I 
when the set (73) is non-empty is when I — 2r. Once simplified, it is defined by 

\t\ = 1, \X2\ < q\ \X3\ = q\ \27Z~'-tx3 + xj - 6(2x3^1 = q^' . 

Alternatively, once X2 and X3 are fixed, t can be any element with |t| = 1 which does not 
belong to (6'(2x3)^ — x\)tz'^ / {2x3) -\- nR. Thus, the volume of (73) is equal to 



(74) 



Case lb. Assume that \297r^ '■tx3\ < qK This subset of (72) is given by 
\t\ < 1, 1x21 < q\ \x3\ = g^ \tx3\ < g^ \A-e^ + {26x3 - Of - Oxjl = qK (75) 
Removing the third inequality, we enlarge the set (75) by 

\t\ < 1, \X2\ < q\ \X3\ = q\ \tx3\ = q\ |4 - + (2^X3 - Of - 9xl\ = qK (76) 
Note this subset is non-empty only when Z = 2r, in which case its volume is 

/ dt f dx2 [ dx3 = (l - -Y q'^' . (77) 

J\t\=l\ J\x2\<q' J\x3\=q^ ^ 

Thus, when I < 2r, the set (75) is given by 

1^1 < 1, \X2\ < g^ \X3\ = g^ 1^31 < g^ \4-e^ + {26x3 - of -exl\^ q\ (78) 
and, when Z = 2r it is the difference of (77) and (76). 
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We obtained that when I < 2r, vo1(Vl(Z)) — Wi — W;_i, and when I — 2r, 
vol(yi(2r)) = W^r - W2r-i + (74) - (77). 
Note that when I = 2r, (70) is equal to {q^Xy and (74)-(77) is 

The integral (65) over the subset of Case 1 is equal to 



where VF/ is the volume of the set defined by 

\X2\ < q\ \X3\ = g^ \4:-e^ + {26x3 - Of - 9xl\ < qK 



Case 2. We have q"' /\2 + 9z\ > l/|a;i + 26'(a;3 — 1)|. Using (67), the integration over a 
in (65) is performed when q~'^ < \a\ < q\xi + 29{x3 — 1)|~^. The integral (65) is equal to 

|3 




\a\ 'i/j{a{xi + 26{x3 — l))x{oi)d^ adxidx2dx3, 

I q-'-<\a\<q\xi+20{x3-l)\-'^ 

where the triple integral is taken over the set defined by 

\xi\ < \x2\ < \x3\ < i^i + 2e{x3 - i)i > 12 + oziq-^-. 

Define / by \xi + 29{x3 — 1)| = qK The integral above can be writen as 



Yl / / / / \afilj{a{xi + 2e{x3 - I))x{a)d''adtdx2dx3, (80) 

JJJ Jq-r<\a\<q\xi+2e{x3-l)\-'^ 

where (for each /) xi, X2 and 2:3 range over the set 

\xi\ < 1x21 < \x3\ < g^ i^i + 2e{x3 - i)i = 12 + 0z\ < (si) 

Applying (67), we split the integral over a into two integrals 

[ + [ ] \a\'iP{a{x, + 2^(a;3 - l)))x{a)d''a = V {q'Xf - ^^^Q^ 

■Jq-r<\a\<q-' J\a\=q^-'^ Q - ^ 

_ {q'Xy-^ - (g3x)- {q^Xy-^ 

7x^1 ^ ^ 
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Making the change of variables in (81), xi — 29{1 — X3) + tt 'e, where |e| = 1, the sum 
(80) is equal to 



1-/-, 



Kr 



q^X-1 



q-1 



(83) 



where ¥2(1) is the set defined by 



|e| = 1, \x2\ < q\ l^sl < g^ |4 - r - 2eTV^-'ex^ + (2^X3 - Oy - 9x^1 = q\ (84) 

Note that since {x^l < q^ and |e| = 1, we have |2^7r~'ex3| < q^^K We distinguish between 
the following subcases. 

Case 2a. Assume that \297r~^€Xs\ = g'^''. It imphes that l^sl = q^. Following the same 
argument as in Case la, we conclude that with this assumption, the only non-empty subset 
of (84) is when I — r. It is defined by 



|e| = 1, \x2\ < q'\ la^sl = q'\ |27r ''exs + x^- ^(2x3)^1 < q 



2r-l 



(85) 



Alternatively, once X2 and X3 are fixed, e should be in — (x| — ^(2a;3)^)7r''/(2a;3) + ttR. 
Note that |e| = 1. The volume of (85) is 



,-(i-i)? 

qJ q 



When I = r (82) is equal to {q^X) ^ - {q^Xy ^/{q-1). The contribution of this case to 
(83) is 

U2^r^^3;,)-._(.^^)-- 



q/ q 



q-l 



Case 2b. Assume that 126*77 ''6X3] < q'''^^ ^. Thus this subset of (84) is given by 



|e| = 1, \X2\ < q\ |X3| = g^ |4 - + (2^3 - Of - OxW < q' 



l+r-l 



(86) 



(87) 



Note that the volume of this set is ^1 — ^^Wi+r-i- 



Combining these two subcases, the integral (65) over the subset of Case 2 is equal to 



£HW14'(1--) 



q^X - 1 



q-l 



Q 



The answer is obtained on adding (79) to (88). Fix any k < 2r. To find the coefficient of 
Wk in (79), we consider the terms when I — k and I — k + 1. This coefficient is equal to 



^k-r iQ'Xy-'^^^ - jq^X)-^ _ ^,+i_, (g^X)-^-(g3x)- 



q^X-1 



q^X - 1 



(89) 
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Similarly, to find the coefficient of Wk in (88), we consider the term with I — 1 + k — r. 
The coefficient is equal to 



l--)q 
Q 



l+k-r 



3 'V\r-k 



q^X-1 q-1 



q^-'^iq^Xy-^ 



(90) 



q^X -I ^ q^X - 1 

The second term of (89) cancels the first one of (90). Thus, their sum is zero. Futher, 

note that 



J\x2\<q-^ J\x3\=q'' 

Thus the sum of (79) and (88) is equal to 



l--)q 



2r 



W2rq' 



q^xy-'' - {q^xy 



— 1 \ qJ q \ qJ Q 



-)- 

qJ q 



q^X 

The Proposition is proved. □ 
Theorem. Corresponding f and f are matching. 

Proof. Indeed as we have seen in Section I.O, to prove that corresponding functions are 
matching (i.e. ^(q;,0/) = V'(q;)|q;|^'(q;~^, 0y;/)) it is enough to show that (for r > 0) 



*(a, $,) = i^{a)\a\^'{a-\ (-1)V(0; ± 4>U))- 



(91) 



Comparing Proposition 3.5 in the split case, and Proposition 3.6 in the non-split case, 
with Proposition 3.1, we have (for r > 1) 

! ^(a,$.)x(«)d^a= / ^(a)|a|*V',(-l)W;±0;-i))x(«)^^"«, 

where x is any complex valued character of . If x is ramified both integrals are equal 
to 0. Fourier inversion formula now implies (91) when r > 1. When r = 0, the formula 
(91) follows from the unit element case, treated in [FM]. □ 
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